Quasiparticle spectrum and dynamical stability of an atomic Bose-Einstein condensate 

coupled to a degenerate Fermi gas 
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The quasiparticle excitations and dynamical stability of an atomic Bose-Einstein condensate cou- 
pled to a quantum degenerate Fermi gas of atoms at zero temperature is studied. The Fermi gas 
is assumed to be either in the normal state or to have undergone a phase transition to a super- 
fluid state by forming Cooper pairs. The quasiparticle excitations of the Bose-Einstein condensate 
exhibit a dynamical instability due to a resonant exchange of energy and momentum with quasi- 
particle excitations of the Fermi gas. The stability regime for the bosons depends on whether the 
Fermi gas is in the normal state or in the superfluid state. We show that the energy gap in the 
quasiparticle spectrum for the superfluid state stabilizes the low energy energy excitations of the 
condensate. In the stable regime, we calculate the boson quasiparticle spectrum, which is modified 
by the fluctuations in the density of the Fermi gas. 

PACS numbers: 03.75.Fi,05.30.Fk 



I. INTRODUCTION 

Since the observation of Bose-Einstein condensation in 
trapped atomic gases Q, there has been increasing in- 
terest in creating quantum degenerate gases of fermions 
with trapped ultracold akali atoms. At temperatures be- 
low the Fermi temperature, Tp, the properties of the gas 
become strongly influenced by the Pauli exclusion prin- 
ciple [^|, H) . Besides exploring the role of quantum statis- 
tics in their behavior, much of the interest in these gases 
has focused on the possibility of achieving the Bardeen- 
Cooper-Schrieffer (BCS) phase transition to the super- 
fluid state by forming Cooper pairs j|, ||, 0, Jj], || . 

Currently, experimental efforts in cooling of fermionic 
atoms of 6 Li §, |§ and 40 K [§ [0J to the quantum de- 
generate regime have made significant progress, reaching 
temperatures as low as 0.2Tp where Tp is the Fermi tem- 
perature. However, the efficiency of the evaporative cool- 
ing process used to cool a two component Fermi gas is 
severely hindered for temperatures below Tp due to Pauli 
blocking Meanwhile, the lack of s-wave scattering 
between spin-polarized fermions makes evaporative cool- 
ing completely ineffective for a single component Fermi 
gas. Furthermore, it has been recently predicted that 
loss processes which remove particles from the trap and 
leave holes behind in the single particle distribution also 
impose a lower limit on the temperature (~ Tp/A) that 
can be reached in a pure Fermi gas |Q. As a result, 
the recent experiments that achieved quantum degener- 
acy in 6 Li have used 7 Li, a boson, to sympathetically 
cool the 6 Li atoms Q. This procedure is also being ap- 
plied to cool 40 K using 87 Rb |l3|]. Therefore, it appears 
likely that future experiments on degenerate Fermi gases 
will be associated with a Bose gas with a non-negligible 
boson-fermion two-body interaction. In a more specula- 
tive vein, the nonlinear mixing of bosonic and fermionic 
matter waves may open up the way to novel methods to 
manipulate these waves, and in particular their statisti- 
cal properties. The theoretical study of the properties of 



coupled Bose-Einstein condensates and degenerate Fermi 
gases is therefore of considerable practical interest to fu- 
ture experiments. 

It is the purpose of this paper to establish a general 
analysis of the quasiparticle spectrum and dynamical 
stability for a BEC coupled to a degenerate Fermi gas. 
There have been a number of recent studies of both the 
ground state properties 0, [ll| [l7) and the collec- 
tive modes for the density fluctuations of the coupled 
gases 18, |l9[ |o[ ^fj. These studies have all treated the 
ground state of the fermions as being that of a normal 
degenerate Fermi gas. The likelihood of observing the su- 
perfluid state in fermionic akali vapors has sparked sev- 
eral theoretical studies of the quasiparticle and collective 
modes of trapped superfluid Fermi gases [^2], . 
However, the quasiparticle excitations of a coupled su- 
perfluid Fermi gas and Bose-Einstein condensate (BEC) 
has not yet been investigated. In this paper, we examine 
both the case when the ground state of the fermions, in 
the absence of a boson-fermion interaction, is the nor- 
mal state and the BCS superfluid state. In both cases, 
the quasiparticle spectrum exhibits a dynamical instabil- 
ity due to the exchange of energy and momentum with 
the fermions. Physically, the existence of the instabil- 
ity implies the existence of a lower energy ground state 
of the coupled system, which involves correlated density 
fluctuations between the BEC and Fermi gas. In the sta- 
ble regime, the quasiparticle dispersion relation for the 
bosons is significantly modified due to quantum fluctua- 
tions in the density of the Fermi gas. More importantly, 
the stability regime and the quasiparticle dispersion for 
the bosons is qualitatively different when the fermions 
are in the BCS state as compared to the normal state. 

In terms of current experiments with trapped atomic 
gases, we are only interested in the dilute limit for the 
Bose-Fermi mixture. In that limit, we can linearize the 
equations of motion for the density fluctuations of the two 
gases, since at zero temperature the fluctuations relative 
to the non-interacting ground state are expected to be 



2 



small. For the bosons, this method is equivalent, in the 
absence of a boson-fermion coupling, to the Bogoliubov 
procedure |2(| . The presence of a boson-fermion coupling 
results in a modified boson-boson interaction due to the 
induced density fluctuations in the Fermi gas. In Sec. II, 
we present our model and derive the quasiparticle spec- 
trum for the bosons when the fermions are in the normal 
state. In Sec. Ill, we show how the calculation of Sec. 
II is modified when the fermions are in the BCS state. 
In the Appendix, we show how quantum correlations be- 
tween the densities of the two gases can lower the ground 
state energy of the mixture. 



II. MIXTURE OF BEC AND NORMAL FERMI 

GAS 

This paper focuses on the effect that the boson-fermion 
interaction has on the quasiparticlcs states of the Bose 
gas. Hence, we neglect the effect of a direct interaction 
between the fermions in this section. For a spin-polarized 
Fermi gas, this is an excellent approximation since s-wave 
scattering between two fermions is forbidden and p-wave 
scattering is negligible at zero temperature. However, for 
the sake of generality, we consider the case of fermions 
with two hyperfine spin states. The results of this sec- 
tion can be directly applied to a single component Fermi 
gas [^7| since we assume that the boson-fermion interac- 
tion and the single-particle energies of the fermions are 
independent of the spin. In the next section, we will gen- 
eralize these results to the case of s-wave Cooper pairing. 
For this purpose, it will be necessary to explicitly include 
an attractive interaction in order to create a non-zero 
pairing field needed for the BCS state. 

Our starting point is the grand canonical Hamiltonian 
for a weakly interacting gas of bosons coupled to an ideal 
gas of fermions with the two spin states, labelled by a =f 

; \ ) 



H = H f 



Hp + H 



BF, 



(1) 



where H B and Hp are the free Hamiltonians for the 
bosons and fermions, respectively, 



d 3 r$j(r) 



h 2 V 2 
2m B 



V B (r) - hb 



+ ^(rhMr) omD. 



H F = E/ rf3 ^to 



ft 2 V 2 
2m f 



+ V F (T)-fJ, 



Vv(r), 



while Hbf represents the boson-fermion interaction, 
Hbf=9bfJ2 f d 3 WU(r)^(r)^(r)V3s(r). 

Here, ^s(r) [^jj(r)] and ^ CT (r) [^J(r)] are the annihila- 
tion (creation) operators for the bosons and for fermions 



with hyperfine spin a, respectively. They obey the stan- 
dard commutation (anti-commutation) relations. \ib 
and \x a are the chemical potentials for the bosons and 
fermions. The coupling constants, gs and gBF, are de- 
fined as 

gs = 4:Trh 2 aB/iriB, gsF = 2nh 2 aBF /m r , 

where as > and cibf are the boson-boson and boson- 
fermion ,s-wave scattering lengths, respectively, while 
to,. = mB'niF / {tub + tuf) is the reduced mass. For sim- 
plicity, we assume that the number of fermions in each 
spin state is the same so that /zj^ = pf- 

To determine the excitation spectrum of the Bose- 
condensate, we apply the standard Bogoliubov procedure 
by decomposing the field operator as 



i> B (r,t) = Mr)+6*(r,t). 



(2) 



Here, ^s(r, t) describes the small amplitude fluctuations 
above the condensate mode, </>s(r), which obeys the 
Gross-Pitaevskii equation, 



2m r 



V B {r) + g B \(f>B(r)\ 2 + 2g B Fn F (r) - pi B (3) 

x<Mr) =0. 



Similarly, we assume that the density fluctuations in the 
Fermi gas are small so that 



4>t ( r . ( r > t) = n F (r) + 5p„ (r, t) 



(4) 



where (5p a (r, t)) = in the absence of any external per- 
turbations. For a trapped gas, the equilibrium density 
of each spin component, Tip (r), may be approximated 
by the Thomas- Fermi expression for the density p[ . 
There is an obvious asymmetry in our treatment of the 
bosons and fermions since for the BEC there is a non- 
vanishing expectation of iPb(t, t) while for the fermions, 
(V> ff (r, t)) = and only the fluctuations in the fermion 
density may be regarded as being small relative to some 
finite mean-field. 

By substituting Eqs. (@) and (0) into Eq. (0), and ne- 
glecting terms involving the product of three or more 
fluctuation operators, one obtains a Hamiltonian that 
is quadratic in £s(r, t) and tp a (r). From this quadratic 
Hamiltonian, one obtains Heisenberg equations of motion 
that are linear in the fluctuations, 

O^b " " 

ih -Qf = ^b£,B + 9B<f> B i B + dBF^B^Spa, (5) 

(7 

ih^t^ = hpipo- + g B F{4> B i B + <^bIs)^o-) ( 6 ) 



at 



where 



h ^-< 



2m B 
h 2 X7 2 
2m f 



+ V B (r) + 2g B \4> B (r)r + 2g B Fn F (r) - p B , 



+ Vf(t) + g BF \<j> B {r)\ 2 -fi F . 
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Equations (0) and (|J) can be thought of as describing a 
four- wave mixing process where a bosonic wave, (f>g(r), 
scatters off the fermionic density grating, 5p a , to create a 
new bosonic wave, £b(i*, t). Equation ^ represents the 
back-action on the fermion grating as a result of the scat- 
tering of the bosonic wave. In contrast to Ref.^], where 
the fermionic grating was created optically, or matter- 
wave superradiance P9| , where the grating results from 
the mixing of optical and matter waves, four-wave mix- 
ing results now from the coupling between the bosonic 
and fermionic matter- wave fields. 

The procedure we adopt here is to formally integrate 
Eq. to obtain a linearized expression for which 
can then be substituted back into Eq. (||) to obtain an 
integro-differential equation for the boson fluctuation op- 
erators. To begin, we expand the fermion field operators 
in terms of the eigenstates of hp, 

•0 CT (r,i) = a n ^(t)tp n (r), (7) 

n 

where hpip n (r) — E n ip n (r). The formal solution of 
Eq. (^) is then given by 

Mr,t) = v£°)( r ,i)-i^p J dt' J ' d 3 r'G{v,v',t-t') 
xS(r',t')^(r',t'), (8) 

where 

$?)(r, t) = J2 «n,,(0)e- E " f/ VnW (9) 

n 

represents the free evolution of the field in the absence of 
a density fluctuation of the BEC, and 

B(r,t) = B (r)4(r,t) + ^(r)fo(r,t). (10) 

Physically, H(r, t) produces a density grating off which 
the fermions can scatter. Consequently, the second 
term on the right hand side of Eq. (||) may be inter- 
preted as the scattering of the fermions off the poten- 
tial 5s^S(r',i') and the subsequent propagation of the 

I 



Equation ( |15| ) is valid to all orders in g B F provided 
the density fluctuations of the bosons, S(r,t), and the 
fermions, <5/5o-(r, t), remain small relative to the equilib- 
rium densities of the two gases. The dependence of £g to 
all orders in gs f is easily seen by iterating the expression 
for S(r, t) inside the integrand to obtain a power series 



fermions to (r, t) by the single particle Green's function, 
G(r,r',*-0 E^e-^C-^/VW^M. (11) 

n 

In order to obtain a linear equation for the boson fluctu- 
ations, we make the first Born approximation in Eq. (^), 
so that 

Mr,t) » $o)(r,t)-i£|£ / dt' J d 3 r'G(r,r',t-t') 

xH(r',i')f(r',0. (12) 

An expression for the fermion density fluctuation that is 
linear in the boson fluctuations is obtained from Eq. (|l^ ) 
and 

8p a = (F\i>i(r,t)Mr,t)\F)-n F (r), (13) 
where \F) represents the zero temperature ground state 
of the Fermi gas. By making use of the fact that at 
T = 0, (F|at iCT (0)a nV ,(0)|F) = <5„,„^ for E n < E F 
and zero otherwise {Ep is the Fermi energy) as well as 
J2 n l^n( r )| 2 — n F(r), we obtain the desired expression 
for the fermion density fluctuation due to the coupling 
to the bosons, 

5p a » i 9 -^- j dt 1 J d 3 r' J(v, r',t- t')E(r', t'), (14) 

where 

J{v,v',t-t') = G* > (r,r',<-t')G<(r,r',t-i') 

-G>(r,r',i-i')G*<(r,r',t-0, 
G>(r,r',t-f) ee ^ (t - 0/ V;(r')^(r), 

{n\E„>E F } 

and G< is the same as G>, but for E„ < Ep in the 
summation. By inserting Eq. ([l4]) back into Eq. (|B|) we 
finally have 



(15) 

I 

expansion in even powers of g B F- 

The physical interpretation of the integral term in 
Eq. ( |l5| ) is straightforward. Since the boson-fermion in- 
teraction is proportional to the local densities of the two 
gases, a density fluctuation in the BEC at r' and t', 
S(r',i'), will excite a density fluctuation in the Fermi 



ih 



dt 



h B £ B (r,t) + .9s0|4( r ^) 



dt' / d 3 r' J(r,r',t-t')E(r',t')(j) B (r). 
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gas at the same point. This density fluctuation consists 
of particles excited above the Fermi surface, which are 
represented by G>, and holes inside the Fermi sea, rep- 
resented by G<. These particle-hole pairs then propa- 
gate from r' and t' to r and t where they excite another 
fluctuation in the density of the BEC, thereby modify- 
ing the value of £ B (r, t) and hence, 3(r, t). The integral 
in Eq. ( |l5|) may then be thought of as a feedback loop 
where the density fluctuations of the Fermi gas act as the 
feedback mechanism. If the BEC is stable, the feedback 
will be negative while for an unstable system, the cou- 
pled boson-fcrmion density fluctuations will result in a 
positive feedback, which causes the fluctuations to grow 
exponentially in time. 

Equation (]l^), which is the main result of this sec- 
tion, is completely general. However, for concreteness, we 
consider a homogenous mixture of Nb bosons and 2Np 
fermions confined in a box of volume V . The correspond- 
ing ground state densities are ng = |</>(r)| 2 = N B /V and 
rip = np(r) = Np/V . The chemical potentials are fig = 
gsnB + 2gBF n f [see Eq. (||)] and Ep = h 2 k F /2mp — 
fJ-F — gBFiT-B where the Fermi wave number is given by 
kp = [(6ir 2 )np] 1 / 3 . For periodic boundary conditions, 

the eigenstates of hp are plane waves </?k(r) = e lk r /VV 
with eigenenergies E^ = h 2 k 2 /2m p — Ep. Similarly, we 
use a plane wave basis for the boson field operator, 



(16) 



modes with k ^ 0, 



(17) 



The quantum state of the mixture can therefore be ex- 
pressed as 



I* 



1 



Nb 



n 4 CT io>, (is) 

k<kp ,(T 



where |0) represents the vacuum state for both the bosons 
and fermions. Note that |$jv) is identical to the state 
assumed by Viverit et al. p"5| , if one includes two spin 
components. 

The function J[r, r',t — t'), which describes the prop- 
agation of particle-hole pairs in the Fermi gas, can now 
be expressed explicitly as 



j(v,v',t-t')= ^ E E 



Hence, the boson fluctuation operator consists of all where £s(fc) = h k /2ms + gsns-, and 



k n >kp k m <kp 
x el (k m -k„).r e - 4 (k m -k„).r' _ c _ a 



Multiplying Eq. (JT^) by e lk ' T /y/V and integrating over 
r one obtains 

ifr-^r = £ B (fc)?7k + 5s«s??i u + T g BF n B I(k), (19) 
at n 

2 1,2 , 



k m <k f 



J(k) = L I d t> I dV I d 3 re- ikT J(r,r',t-t') ^e lk ' r ' [t£ k , (*') + jfc, (t' 



vf." S [■ 

•"J US' u _ 



lk m +kl 2 -*4)(t-t') 



c.c.l e(|k m + k|-M r/L k (t') + 



where Q(x) is the unit step function. By taking the ad- one obtains the inhomogeneous linear equations 
joint of Eq. ( |l9|) and using k) = — I(k) one gets, 

d * i 
ih ~g^ = -^B(k)rj!_ k - g B n B rjk - ^PsF^B-fCk). (20) 

The coupled integro-differential Eqs. (|l^) and (^0|) may 
be solved using Laplace transforms. Denoting the single- 
sided Laplace transforms as, 

/>oo 

Ok(«) = L[m(t)]= / dte- st r]u(t), 
Jo 

poo 



5 



where 
ik(s) 



ifr[sak(s) - r)k(0)] = £s(fc)ak(s) + gs^s/3k(s) 
ih[s(3 k (s) - r?l k (0)] = -£s(fc)/?k(s) - 3Bn B ak(s) 



9bf 
h(2i:f 

9bf 



2i(2w) 3 
2 / dk r 



k m +k|>/c f 

£ 

k m <k F 



e i(\E k+km \+\E km \)t/H _ c c 



1 



•ns4(s)[ak(s) + /3k(s)], 



n B 4(s)[a k (s) + /3k(s)], 



1 



- (|£WkJ + l^k m |)/fi -is + (|£k+k m | + \E k J)/h 

I 



(21a) 
(21b) 

(22) 



6(|k m +k| -k F )Q(k F - k n 



and in the second line we have taken the infinite volume 
limit to convert the summation to an integral. The solu- 
tions of Eqs. ( pi] ) are, 



«k(s) 



Ac (a) 



[Cfc(5) + ^.s + r fc )?7 k (o)] 

(ifei) 2 ™ Zfe(s) 

-a(*) + (i^-T fc )»/U(0) 



(ifo) 2 - z fe (s) 



(23a) 
(23b) 



where = h 2 k 2 / {2ms) and 



Cfc( s ) = n B 
z k (s) = T k 



9b 



9 2 BF e k(s) 



h(2ir) 3 
T k + 2n B ( 9b 



%(o)+7?i k (o) 



gig 

S(2tt) : 



4(s) 



The poles of Eqs. ( p3|) in the s-plane correspond to the 
quasiparticle excitation frequencies of the condensate. 
For gsF = 0, one obviously recovers the Bogoliubov spec- 
trum of a pure weakly interacting BEC. For s = ilu + + , 
£fc(s) is proportional to the density-density response func- 
tion of an ideal Fermi gas, which measures the linear 



response of the density of the gas to a scalar perturbing 
potential Q. The expression gs + g 2 BF ik{s) /h(2ir) 3 cor- 
responds to a renormalized boson-boson interaction due 
to the polarization of the density of the Fermi gas. 

We already mentioned that in case of positive feedback 
between the density fluctuations in the two gases, the 
BEC becomes unstable. Mathematically, the stability of 
the BEC is determined by the location of the poles in the 
s-plane, 



(ihs) 2 -z k {s) =0. 



(24) 



In order for the BEC to be stable, Re[s] < for all so- 
lutions of (p4|). A positive real part of any of the poles 
indicates the existence of an instability in the BEC. 

To evaluate the boson excitation frequencies in the sta- 
ble regime as well as the location of the instabilities it 
is sufficient to make the substitution s — iio + + , in 
which case the condition that the BEC be stable corre- 
sponds to poles with Im[aj] > 0. The real and imaginary 
parts of 4(^0 = £k(s = ilu + + ) can be obtained using 
l/(x ± i0+) = P(l/x) T ^S(x) M, 



in 



lu + a(k F - ft/2) 



kp 



In 



lu — a(k F — ft/2) 



lu - a(k F + ft/2) 

Im[4H] = 2n J dk m Q(\k m +k\-k F )Q(k F -k m )x S(uj-\E km+k \/n-\E k J/n) 



lu + a(k F + ft/2) 



2ft F ft 



(25) 



where a = Hk/m F . 

The mechanical stability of the condensate, which re- 
quires its compressibility to be positive, can be derived 
from the zero frequency (lu — 0) static limit for the speed 
of sound in the condensate. From Eq. pj), in the long 
wavelength limit (i.e., ft — > 0), we have ur = c 2 B k 2 where 



cb is the speed of sound. A positive compressibility cor- 
responds to c B > 0. From Eq. (^J), c 2 B is given by, 



n B 
m B 



9B 



9 2 BF 



/i(2tt) 3 k^o 



lim 4(0) 



(26) 
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Using the expansion of 4(0) for k <C &f, 



4(0) 



-2 



1 

6 \k 



one obtains the mechanical stability condition, 

A 9b 



1/3 



< 



(27) 



(28) 



where A = (H 2 /2mp)(67T 2 ) 2 ' 3 , or in terms of scattering 
lengths, 



l BF 



< 



'KaBTriBfriF 
kp(rriB + mf) 2 



Eq. ( p8| ) agrees with the result obtained in Refs. 15, lj, 
|l9| when one accounts for the two spin components. In 
the following it will be assumed that Eq. (28) is satisfied. 



A necessary condition for the BEC to be dynamically 
stable with respect to density fluctuations of finite energy 
and momentum is that Im[4(^)] = 0. Since Im[4(w)] is 
proportional to the dynamic structure factor of the Fermi 
gas, it measures the rate at which energy and momentum 
can be resonantly transferred between the density fluctu- 
ations in the Fermi and Bose gases [30 . In the absence 



of any decay or dephasing mechanism for the boson or 
fcrmion quasiparticles, the existence of a bosonic quasi- 
particle with energy Mle[cj(k)] such that Im[4(w)] ^ 
will give rise to coupled oscillations between the density 
fluctuations with wave vector k, similar to Rabi oscil- 
lations for a two-level atom coupled to a quantized field 
|f32f . One may then consider a new ground state, which is 
a superposition of a bosonic and fermionic density fluctu- 
ation, in analogy to the dressed states of quantum optics 
p2[ . In the appendix it is shown that such a superposi- 
tion can result in a state with an energy lower than the 
state used in this section and in other studies of Bosc- 
Fermi mixtures @, ||, ||, H, H, H > which do 
not contain any quantum correlations between the den- 
sities of the two gases. This indicates that a dynamical 
instability signified by Im[4(aj)] 7^ leads to a lower en- 
ergy ground state of the Bose-Fermi mixture. It is worth 
noting that the dynamical instability is distinct from the 
mechanical instability of the mixture, discussed previ- 
ously. A mechanical instability due to the Bose-Fermi 
coupling leads to a demixing of the two gases and occurs 
in the static (lu = 0) limit for which Im[4(w)] is always 
zero. 

For excitations of the BEC with frequency to and wave 
number k < 2k p, the stability criterion determined by 
Im[£fe(cj)] = requires the excitation frequency to satisfy 



hk 2 

2m p 



hkkp 
mp 



(29) 



Physically, h 2 k 2 /2mp + h 2 kkp/mp is the maximum en- 
ergy that a particle-hole pair can have for a given k. 
Hence, the stability criterion corresponds to there being 
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FIG. 1: Stability diagram of a Bose-Fermi mixture. We as- 
sume rriF — tub = m. We have adopted a system of units 
in which the units for frequency, length, and wavenumber are 
hk%/2m, I/^f, and kF, respectively. Note that in this units, 
the fermion density is given by n F = 1/(6tt 2 ) w 0.017. 



no excitations of the Fermi gas that can resonantly cou- 
ple to the condensate quasiparticle. The stability regime 
and the phonon spectrum can be obtained by first solving 



(hu) 2 = Z k (iLO + + ) 

T fc T k + 2n B ( 9b 



9%f 

h{2TT)' 



Re[4M] 



(30) 



numerically while assuming Im[4(u')] = 0, and then 
checking if the system is stable using the criterion (|2^) . 
Fig. ^ shows the stability diagram of the mixture in the 
clbf — ns space. As can be seen, the dynamical stabil- 
ity of the system is determined by both the scattering 
lengths and the atomic densities. All other parameters 
being fixed, the stability condition (|2^) imposes a min- 
imum boson density n™" beyond which no stable ho- 
mogeneous mixture exists. For k <C fc^, we can use the 
linear part of the Bogoliubov spectrum for a pure con- 
as 



densate to estimate n 7 g m 



h 2 k 2 F 



?/m B 



H 2 (6ir 2 n F ) 2/3 
m 2 F /mB 



For realistic numbers, n™" is about two orders of mag- 
nitude larger than np (see Fig. [l]). 

Figure || illustrates the phonon spectrum for the BEC 
in the Bose-Fermi mixture when ns > fi™" . The boson- 
fermion interaction increases the sound velocity of the 
phonons. This effect has a straightforward explanation 
in terms of the stability condition imposed on the boson 
quasiparticle excitation frequency. In the stable regime 
determined by (|29|), the density-density response func- 
tion £fc(cj) can be easily shown to be positive, hence w(fc), 
as given by Eq. (130), is increased. 
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FIG. 2: Phonon spectrum of a boson-fermion mixture. The 
thick solid line corresponds to lo — h(k 2 + 2kkp) /2mF ■ Fre- 
quencies fall below this line represent unstable excitations. 
Same units as in Fig. hi. 



For small values of clbf, the spectrum is stable and 
single- valued. By expanding lk(v) around small k/kp 
and finite to, we can calculate the sound velocity, c, in the 
condensate for finite u> and fc. Expanding t^iuS) to lowest 
order in k/kp, we obtain tk(u) = (8irh/3)(k F k 2 /mpu 2 ), 
and hence the sound velocity is 



Co 



1 



n 2 k 3 



3>i: 2 gBfnFC^ 



(31) 



where cq = \J gB n B / m B is the sound velocity in a pure 
condensate. For the parameters in Fig. [|, we have a 6% 
increase in sound velocity if cibf changes from to 0.14. 
However, further increasing clbf beyond a critical value 
a max S pmg th e phonon spectrum into two branches, and 
one of them falls into the unstable regime. The criti- 
cal value of asF for which the spectrum splits into two 
branches corresponds to the equality in Eq. (p8[). For 
mp w mfl,we have a r g F x — ^JiraB/kp /2, which gives the 
maximum sound velocity achievable in a homogeneous 
mixture 



= co 1 



hkp/(\/3' 



m F ) 



where cf 

Fermi gas (3l]. Note that while n 
o-bf, a>g F x is independent of tib 



is sound velocity of the ideal 
is independent of 



mm 
B 



III. MIXTURE OF BEC AND SUPERFLUID 
FERMI GAS 

In order for a BCS transition to occur in a system of 
fermions, there must be an attractive two-body interac- 
tion which allows the fermions to form Cooper pairs. At 



the ultracold temperatures achieved in current experi- 
ments, p-wave collisions between atoms are highly sup- 
pressed and s-wave collisions between atoms in the same 
internal state are forbidden by the Pauli exclusion princi- 
ple. As a result, the most likely possibility for the forma- 
tion of Cooper pairs is an attractive s-wave interaction 
between atoms in different hyperfine states. Fortunately, 
6 Li and 40 K appear to be very promising candidates. 6 Li 
possesses an anomalously large and negative s-wave scat- 
tering length, a = — 2160as where as is the Bohr radius 
Q. For 40 K, a Feshbach resonance exists for two of the 
hyperfine states which can be used to create a large neg- 
ative scattering length of a » — lOOOas ||. To deal with 
this situation, we now include in Eq. (pi) the term 



Hpp — 



-9f 



d 3 r^{(r)^J(r)^(r)V; T (r), 



(32) 



where gF = 4:irh 2 \ap\/mF and clf < is the s-wave scat- 
tering length between fermions in the spin singlet state. 
Hff can be treated using the self-consistent field method 
by replacing pairs of fermion operators in Hff with c- 
numbers [B3||, 



H 



ff 



= d 



~g F n F {v) i>t (r)Vv ( r ) 
+A(r)$(r)$(r) + A*(r)^(r)^ T (r)l ,(33) 



where 



A(r) = - 5F (^(r)^ T (r)), 



(34) 



and the expectation value is taken with respect to the 
BCS ground state defined below. A(r) is the order pa- 
rameter for the BCS state. It represents the correlation 
between fermions that have formed Cooper pairs and is 
zero for the normal state of the Fermi gas. The term 
proportional to —gpnp(r), is a Hartree-Fock mean-field 
which is present even in the normal state for an interact- 
ing Fermi gas. The inclusion of a Hartree-Fock term for 
the normal state does not affect any of the results of the 
last section since, in particular for a uniform system, it 
can be absorbed into the definition of the Fermi energy. 

We now proceed as before and calculate the quasipar- 
ticle spectrum for the bosons. Eq. (||) is still valid, but 
Eq. (|6j) is now replaced by the pair of equations 

ifi-gf =-h' P 1>l+A*(T)1> r -g BF E(T,t)il>l, (35b) 

where h! F = hp — gpnp(r). In the absence of the Bose- 
Fermi coupling, Eqs. (|35[) may be solved by a canonical 
transformation 

^M) = X] ["n( r ) a nT(*) - u n( r )«n|(*) >( 36a ) 
n 

$(r,i) = ]T ^(r^W + ^CrKtCi)] , (36b) 
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where a na {ct\ ia ) are annihilation (creation) operators 
for quasiparticles, which obey fermionic anticommutation 
relations {oi< na , a ma >} = 5 n , m 8 a . a , and {a na , a m<T > } = 0. 
As a result, the amplitudes, u n and v n , are subject to 
the orthonormality condition 

J d 3 r [u*(r)u m (r) +v*(r)v m (r)] = <5 n , m . 



The formal solutions of Eqs. (|3^) in terms of the quasi- 
particle operators are 



a„ T (0)e- iE » i / fi 
Wbf '" 



dt' dhe-^-^S^t') a mT (t')«ti OT -<»m)-«4 li (t , )«C+«) . ( 37a ) 



4 ; (0)e te -*/' 1 



53/ dt' / d 3 re ,£ "( f - i '»/ s S(r,0 a mT (t') (u n « m + w n u ro ) + (f) {u n u* m + « n <) . (37b) 



The eigenenergies for the quasiparticles, e n , are obtained 
from the Bogoliubov-de Gennes equations 

e n u n (r) = h' F u n (r) + A(r)u„(r), 
e«w„(r) = -%rU„(r) + A*(r)w„(r). 

Following the same strategy as previously, the quasiparti- 
cle operators inside the integrals of Eqs. ( |37| ) are first re- 
placed by their free evolution values for gsF — 0, and the 
densityfluctuations of the Fermi gas are calculated using 
Eqs. (|36| ) and Eq. (p^|). However, instead of \F), here 
the expectation value is calculated with respect to the 
BCS ground state, |$o)- We recall that |$o) is the vac- 
uum state for the quasiparticles so that only terms of the 
form ($o|awai' cr '| < I'o) = 5 n ^S a ^ give a non-vanishing 
contribution to 5p a . Carrying out this procedure, one 
arrives at equations for the boson density fluctuations 
that have the exact same form as Eq. (|l^) except that 
J{y, r', t — t') is replaced by the expression 

J(r, r', t - f ) = \ 53 [F n>m (r, t' ~ t)F^ n (r' , t-t')- c.c] , 

n,m> 

where F 7urn (v,t) is defined as 

F n)m (r,t) = K(r)^(r)+<(r)u^(r)]e- fe « t / R . (38) 
Using J(r,r',t — t') in Eq. ( |l5| ) gives the effect on the 



bosons of density fluctuations in the Fermi gas resulting 
from the creation of pairs of BCS quasiparticles. 

Again, we consider the specific case of a uniform sys- 
tem of volume V. In this case the quasiparticle ampli- 
tudes are plane waves 

u n (r) = -^=U k e lkr , v n (r) = -^V^', 
yV yv 
and the energies of the quasiparticles are given by 

e k=v /^ + A 2. 

The order parameter, A(r) = A = {sf/V) J2 k UkVk, 
is a constant. As mentioned before, the Hartree-Fock 
energy is absorbed into the definition of the Fermi energy, 
Ep = [Lp — gBpnp + gp^F. The amplitudes are most 
easily expressed in terms of the angle # k defined by 

U k = cos(0 k /2), V k = sin(0 k /2), 

where tan0 k = A/E k , which along with e k , is obtained 
from the solution of the Bogoliubov-de Gennes equations. 

By following the procedure of Sec. II, we obtain solu- 
tions for the Laplace transforms of the — k component 
of the boson density fluctuation that are identical to 
Eqs. (|23|), except that the density-density response of the 
ideal Fermi gas, £k(s), is replaced by the density-density 
response of the BCS state, £k(s)- It is given by 
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4(s) 



i(2w) s 
V 

dk r 



J(sk+k m +£k m )t/H 



c.c sin 



7 k+k„ 



-is - (£k+k m + ^k m )/^ -*S + (£k+k m + £k m )/fi. 



2^k+k„ 



(39) 



It is easy to show that for A = 0, one recovers the results 
of Sec. II. 

Physically, the poles of £k(s) correspond to the en- 
ergies required to create a pair of quasiparticles with 
momentum k + k m and k m , just as was the case for 
£fc(s). When comparing Eqs. (|2~3) and (39), we ob- 



serve that the Heaviside step functions are replaced by 
sin 2 [(#k+k m + 0k m )/2]. Physically, this accounts for the 



lack of a sharp Fermi surface in the BCS state. We re- 
call that £k(s) accounts for the boson- fermion interaction 
which results from a coupling between the local densities 
of the two gases. In k-space, the interaction takes the 
form of a coupling between the — k component of the 
boson density fluctuation and the k t/l component of the 
fermion density, p^. In terms of the BCS quasiparticle 
operators, /9k has the form |p5|, 



Pk = [(fk+k m Vk + C^k^k+k m ) (4+k m f4| + a k+k m j.akTj + (f/k+k m £/k ~ VkVk+k m ) ("k+k m T ak f + a k,|. a k+k m u 

(40) 



When pk acts on |$o), only the first term, which 
creates two quasiparticles, gives a nonzero contri- 
bution. Consequently, |E/k+k m Vk + t/kVk+k m | 2 — 
sin 2 [(#k+k m + 0k m )/2] is the probability to create a pair 
of quasiparticles as a result of a fluctuation in the — k 
component of the density of the Bose gas. 

Using s = iuj + + , the imaginary part of £k(s) is 

Im[4M] = tt J dk m sin 2 [(0 k +k m + 0kJ/2] 

x 5(ui - e km+k /h- s km /h) . (41) 

In order for the BEC to be stable, Im^^)] = 0, the 
energy of a density fluctuation in the BEC must satisfy 

hw < 2A, (42) 

where 2A is the minimum energy needed to create a pair 
of quasiparticles in the Fermi gas. This condition is qual- 
itatively different from (p9|), which imposed a lower limit 
on the energy of the condensate excitations. The pres- 
ence of Cooper pairing acts to stabilize the low energy 
excitations of the condensate. However, for shorter wave- 
length excitations, the quasiparticle energy can exceed 
2A. This condition limits the wave number of the sta- 
ble excitation to be below some maximum number which 
can be estimated using the unperturbed Bogoliubov spec- 
trum as k m ax ~ 2A/(/jco) ■ 

Due to the form of Re[lfe(o;)], the dispersion relation, 
Lu(k), in the stable regime must be evaluated numerically. 
Fig. |^ shows uj{k) for the BCS state of the Fermi gas. In 



0.3 




0.05 0.1 0.15 0.2 0.25 

k 



FIG. 3: Phonon spectrum of a boson-fermion mixture. The 
Fermi gas is in a superfluid state. o,bf = for the dashed 
line, and o,bf = 0.1 for the solid line. Other parameters are 
as ~ 0.04, riB = 1 and A = 0.1. Same units as in Fig. |l| 



contrast to the normal state for the fermions, the BCS 
state results in an w{k) that is reduced below that of 
the Bogoliubov spectrum of a pure condensate. Again, 
this is a result of the stability criterion ( (42| ) , imposed on 
the energy of the excitation of the condensate. For the 
BCS state in the stable regime determined by ((42|), the 
density-density response function lk{^>) is always nega- 
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tive. From Eq. (|30|), it follows that u/(k) is reduced in 
this case. 

It is worth pointing out that when A <C Ep (which is 
usually the case), one can show that £k(u) in the k — ► 
and ui = static limit yields £fe(Q) ~ —SnmFkF / 'h, which 
agrees with the analytic result for the normal state of 
the Fermi gas [see Eq. (f27j)]. This indicates that the 
mechanical stability of the Bose-Fermi mixture does not 
depend on the state of the Fermi gas. 



IV. CONCLUSIONS 

In this paper, by extending the standard Bogoliubov 
linearization procedure, we have analyzed the excitations 
of a weakly interacting Bose-Einstein condensate coupled 
to a degenerate Fermi gas at zero temperature. We de- 
rived general expressions for the excitations of the con- 
densate in the presence of a Fermi gas that are valid for 
abitrary spatial geometries. When we specialized our re- 
sults to the case of a spatially homogenous system, it 
was found that the quasiparticle spectrum for the con- 
densate exhibits a dynamical instability due to the cou- 
pling between the Bose and Fermi gases. The instability 
corresponds to the resonant exchange of energy and mo- 
mentum between the bosonic quasiparticle and pairs of 
quasiparticle excitations in the Fermi gas. In the stable 
regime, quantum fluctuations in the density of the Fermi 
gas modify the quasiparticle spectrum of the BEC. In the 
long wavelength limit, the speed of sound in the BEC is 
increased (decreased) when the Fermi gas is in the normal 
(superfluid) state as compared to the Bogoliubov speed 
of sound for a pure weakly interacting condensate. This 
difference arises from the different stability criteria [see 
Eqs. ( p9| ) and (^2|)] which are determined by the nature of 
the resonant coupling between the bosons and fcrmions 
in the mixture. 

This paper lays the groundwork for the study of non- 
linear wave-mixing between degenerate beams of bosons 
and fermions. Future work will extend the results ob- 
tained here for the equilibrium state of coupled Bose- 
Fermi gases to the nonequilibrium mixing of bosonic and 
fcrmionic matter waves. In contrast to the equilibrium 
case, where the instability signals the existence of a new 
ground state of the system, the existence of an instability 
in the nonequilibrium wave-mixing indicates exponential 
growth in one of the matter wave modes. 

In the current work, we have focused on the quasipar- 
ticle excitation spectrum of the bosons in the mixture. 
Future work should include the study of the induced 
fcrmion-fcrmion coupling due to their interaction with 
bosons. This will shed light on the long-sought goal of 
inducing Cooper pairing of fermions using bosonic atoms 
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V. APPENDIX: GROUND STATE WITH 
CORRELATED BOSE-FERMI DENSITIES 

In this appendix we examine the ground state energy 
of a BEC collisionally coupled to a normal Fermi gas in 
a box of volume V. We show that a variational ground 
state wave function with a finite probability amplitude 
for excitations with opposite momentum in the BEC and 
the Fermi gas can result in an energy that is lower than 
that of the ground state used in Section II. The varia- 
tional wave function we propose in this appendix is not 
necessarily the true ground state of the system, but in- 
stead provides an indication of the possible form of the 
ground state that the system evolves to in the presence 
of a dynamical instability. 

The Hamiltonian, H' for the Bose-Fermi mixture writ- 
ten in a plane wave basis has the form (note that in this 
appendix we do not use the grand canonical Hamilto- 
nian) , 

H' = H T + Hbb + H B f , (43) 

where 

tt 9b t t 

Hbb = 7^ 2^ VL+^L'-diTk'Vk, 

k,k',q 

£t 9BF \ -> » i 

H BF = — 2^CqPq- 

q 

Ht represents the kinetic energy for the Bose and Fermi 
gases while Hbb is the collisional interaction between 
bosons. The boson-fermion interaction, Hbf, has been 
expressed in terms of the operators for the q" 1 Fourier 
component of the fermion density, 

Pi = Yl a k'+ q( x a k' ff (44) 

k'er 

and the boson density, 

k' 

Note that /o_ q = p q and similarly, £_ q = £ q . In contrast 
to Sections II and III, where the k = condensate mode 
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for the bosons was treated as a c-number, we now retain 
the operator dependence for the k = mode, r] , in the 
Hamiltonian. As in Sec. II, we neglect the direct fermion- 
fermion interaction. 

In Sec. II, the equations of motion for the density 
fluctuations were linearized around the T = ground 
state for the non- interacting Bose and Fermi gases, I^jv), 
which was implicitly assumed to remain a stable ground 
state for the interacting Bose-Fermi system. However, 
the existence of the dynamical instability indicates that 
l^jv) is actually not stable and that there exists a ground 
state with a lower energy than |^jv)- The expectation 
value of the Hamiltonian with respect to |vPjv), En — 
(^nIH'I^n), is easily found to be, 



En 



k<kF 



h 2 k 2 

2m f 



+ 9 f{Nl- N B ) + ^N BNl 



V 



(46) 



\^?n) is equivalent to the ground state used in previous 
investigations of Bose-Fermi mixtures, in the sense that 
l^jv) does not include any quantum correlations between 
the bosons and fermions, i.e. \^n) factorizes in to the 
product of the wave functions for the condensate and the 
ideal Fermi gas. 

Any excitation with finite momentum in the two gases 
will increase the total kinetic energy, Ht, but may result 
in a decrease in the interaction energy between the bosons 
and fermions. For example, consider the wave function, 

l*£>) = (uq + UqKq^Wj/v^Vs) 1^) 
= ("q + fqf q ^qP-q/ V^b) \^ n) , 

where |u q | 2 + |w q | 2 = 1 and 

< = (^nIp^n) = 2 J2 Q ( k r - fc ) Q (l k - ql - M- 

k 

The action of CqP-q on \^n) is to create a state with a 
density fluctuation of momentum /iq in the BEC along 
with a density fluctuation of momentum — fi,q in the 
Fermi gas. It is easy to show that, just like \^n), \^d) 
corresponds to a spatially uniform state with densities 
Nb/V and 2Nf/V for the Bose and Fermi gases, re- 
spectively. The difference between \^d) and \^n) is 
made manifest in the correlation between the boson and 
fermion densities, 



(* w |^ B (r)]Tv^/v(rOI*A 

(7 



N B 2N f 

~v v~' 

N B 2N f 



(47) 



•^y^KIK|cos[q- (r-r')+7]> 



(48) 



where 7 = arg(u*i; q ) is the relative phase between Uq and 
Vq. The density-density correlation for \^d) depends on 



the quantum coherences, u q w q , and can be made larger 
or smaller than ([j?] ) by varying 7. This can be used 
to lower the boson-fermion interaction energy since it is 
proportional to the spatially integrated density-density 
correlation between the two gases for r = r'. 
The difference in the energy of the two states is 



AE = (i&nlH'Wn) -E 



N 



= E 1 {q)vl + -E 2 {q)(vqUq + v t 



q"qj 



Ei(q) represents the increase in the kinetic energy and 
the mean field energy of the condensate, 



Ei(q) 



2„2 



K 2 q 
2m j 



|k-q|>/c F /fe2 „2 



2kZ 



/ h 2 q 2 fi, 2 k • q 



k<kF 



mp 



\2mp 

while E2{q) is due to the boson-fermion interaction, 



N B 
2 9 b^, 



E 2 {q) = IgBFVNBKq/V. 



Now let v a = sin < 



> q and Uq 



± COS (j)q for < (f)q < 7r/2. 

For Uq, we use the upper sign for gsF < and the lower 
sign for gsF > 0. By minimizing AE with respect to q 
one finds that the minimum value of the energy difference 
is 

1 



E 1 (q)-^/E 1 (q) 2 +E 2 (qy 



which occurs when tan2</> q = \E2{q)\/ E\(q). Note that 
AE m i n < for all values of q, which indicates that quan- 
tum correlations between the densities of the two gases 
can lower the energy. Consequently, \^n) 1S n °t the true 
ground state of the Bose-Fermi mixture. To find the true 
ground state, \^d) would have to be extended to treat 
density fluctuations in all modes. This is a non-trivial 
task that will be the subject of future work. 

We want to stress here that even though \^n) is not 
the lowest energy state, this does not necessarily mean 
that it is dynamically unstable. The relationship between 
the states \^d), \^n) and the dynamical stability condi- 
tion, Im[£fe(o;)] = 0, can be understood in the following 
manner. Suppose we start with the BEC and Fermi gas in 
separate unconnected boxes so that the quantum states 
for the Bose-Fermi system is factorizable into the prod- 
uct of the BEC state and the state of an ideal Fermi gas 
at T = 0, namely l^w). If we then bring the two gases 
together in the same box so that they can interact, then 
l^jv) will evolve into an entangled state with a form sim- 
ilar to \^d) provided that Im[£ q (cj(q))] ^ 0, where hw(q) 
is the energy of the density fluctuation in the BEC. This 
is because (a) correlations between the density fluctu- 
ations only develop if there is a coupling between the 
fluctuations in the two gases; and (b) since lm[£ q (uj(q))] 
is proportional to the dynamic structure factor for the 
Fermi gas, it measures the strength of the resonant cou- 
pling between the two gases. If lm[£ q (uj(q))} = 0, the den- 
sity fluctuations in the two gases with momentum ±/lq 
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are uncoupled and there is no way to generate any quan- 
tum correlations between the two gases, thereby lowering 
the energy of the system. 

This argument can be made quantitative if we evalu- 
ate the state of the Bose-Fermi system to first order in 
pertubation theory. If we work in the interaction repre- 
sentation where 

H BF (t) = e i(HT+H BB )t/Hfy BFe -i{H T +H BB )t/n^ 



then the state of the system at time t starting from the 
ground state of the uncoupled system is, to first order in 
9b f, 



*(*)) = 1 - ih- 1 / dt'H BF {t') |*jv) 



By letting i->oowe obtain, 



|*(oo)) = il-2iTrg BF n- 1 VV 



q 



'/o 



T7 a l-q<r a ^ s - h ( k - q) 2 / 2 ™F + hk 2 /2m F ) 

kcr 



I* 



N 



(49) 



r 



which has a form similar to that of \^d) generalized to 
include all modes for the coupled density fluctuations. 
The delta function implies that correlations are dynam- 
ically generated between £ q and those components of p q 
that conserve energy in the t — ► oo limit. Note that 
hu>(q) in Eq. (|4^) is equal to the energy of a Bogoliubov 
quasipaticle in the uncoupled BEC since dispersive effects 
due to the Bose-Fermi coupling are higher order in gsF- 
From |W(oo)), one sees that the interaction between the 
bosons and fermions will naturally lead to an entangled 
state provided the term in brackets is nonzero. It is easy 
to see from Eq. ( p5| ) that 



kcr 



ftfc - q) 

2m f 



hk 2 \ 

2m F J 



|*jv) = 0, 



unless Im[£_ g (o;(— q))] ^ 0. Note that for an isotropic 
system, lm[t- q (u){-q))] = lm[l g (ui(q))]. 



To summarize, we have shown that the existence of 
a dynamical instability indicates that entanglement be- 
tween the Bose and Fermi systems can be dynamically 
generated by H BF starting from the factorizable state 
In this variational wave function such as 

\^d) that involves an entanglement between density fluc- 
tuations in the two gases with opposite momenta can 
have lower energy than |Wjv). 
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